100 



Docket Number: MS1-1848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 1 of 18 



114 




COMPUTER 102 



Timeline Generator 120 



Timeline Source 124 



Media 104(1) 



Hi 



Media 104(10 



Media 104(TO 



Application 106(1) 



Application 106fn) 



Application 106fN) 



Media Timeline 122 



Input Device 1080) 



Input Device 1 08(m) 



Input Device 108(M) 



Output Device 110(1) 



Output Device 110(i) 



Output Device 110(J) 




l_n_ 




loo Id I 



Docket Number: MS 1-1 848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 2 of 18 



200 









Application 202 


— ► 


Destination 
224 









Media Foundation 204 



Timeline Source 124 



Source Resolver 216 



Media Timeline 122 



Topology Loader 232 



Timeline Plugin 234 



ByteStream Plugin 236 



Media Engine 208 



Media Session 214 



Media Processor 212 



Topology 230 



> 

Media Source 208 




Media 






Presentation 






226 










Media 






Stream 228 












A 



Transforms 
218 



Media 
Sink 

220 



V 



Media 
Sink 

222 



Media 206fe) | 



300 



Docket Number: MSI -1848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 3 of 18 



.PARENT 
CHILD 



Node 306 



Metadata 318 



Leaf Node 310 



Metadata 322 



Pointer 328 



Root Node 302 



Metadata 314 



Node 304 



Metadata 316 



332 







Media 330 




Leaf Node 312 



Metadata 324 



Pointer 334 





Leaf Node 308 



Metadata 320 



Pointer 326 




108(1) 



r 



114 



— - 


L_aJ 

P \ 

I — 1 






l«l 
1 1 










118 




■11 

DDDDDDD 









Docket Number: MS 1-1 848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 4 of 18 



400 



Sequence Node 402 



Metadata 410 



Leaf Node 404 



Metadata 412 




Pointer 41 8 





Media 424 



Leaf Node 406 



Metadata 414 




Pointer 420 





Media 426 



Leaf Node 408 



Metadata 416 




Pointer 422 





Media 428 



500 



Node 502 



I 



0 Sec. 



Leaf Node 504 



Metadata 510 



Time 516 



20 



Sec. 



Leaf Node 506 



Metadata 512 



Time 518 



0 



Sec 



Leaf Node 508 



Metadata 514 



^c^, 5 



Docket Number: MS 1-1 848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 5 of 18 



Parallel Node 602 



Metadata 604 



Leaf Node 606 
Metadata 610 



Time 622 



Pointer 614 

















Media 6J8 





Leaf Node 608 



Metadata 612 




Time 624 






Pointer 616 







Media 620 



Docket Number: MS1-1848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 6 of 18 



Node 702 




Metadata 704 




URL 706 


Source Object 708 


Source Object ID 710 


Start Time 712 


Stop Time 714 


Media Start 7_16 


Media Stop 7J8 


Time Format 720 


Stream Selection 722 


Format Based 724 


Loop Count 726 


Disabled 728 


NoSkip 730 


NoSkip Child 732 





Docket Number: MS 1 -1 848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 7 of 18 



800 



Node 802 



Metadata 804 



Effect 806 




Effect 808 




Effect 810 







Pointer 816 



814 



Media 812 



900 



Parallel Node 902 



Metadata 904 



Effect 906 



I 



Effect 908 



Effect 910 



Leaf Node 912 



Metadata 916 



Pointer 920 



Media 924 



Leaf Node 914 



Metadata 918 



Pointer 922 



Media 926 



Docket Number: MSI -1848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 8 of 18 



Sequence Node 1002 

Metadata 1010 

T ransition Effect 1012 
Duration 1032 




Leaf Node 1004 



Metadata 1014 



Pointer 1020 









Media 1026 





Leaf Node 1006 



Metadata 1016 



Pointer 1022 



Media 1028 



7<^. w 



Leaf Node 1008 



Metadata 1018 



Pointer 1024 



Media 1030 



1100 



Node 1102 



Metadata 1104 



Effect Metadata 1106 



Effect Object GUID 1108 



Effect Object 1110 



Priority 1112 



Start Time 1114 



Stop Time 1116 



Time Format 1118 



Duration 1120 



Number of Inputs 1122 



Number of Outputs 1124 



Output Major Type 1 126 



Input Connections 1 128 



Docket Number: MS 1-1 848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 9 of 18 



1200 



1220 



Root Node 1202 



Metadata 1218 



Node 1204 




Metadata 1222 










Node 1212 



Metadata 



1228 



~1 




LeafNode 1214 



Metadata 



Pointer 



LeafNode 1216 



Metadata 




Pointer 





Docket Number: MS 1-1 848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 10 of 18 



1300 



Node 1306 



Metadata 1310 



Pointer 



Node 1302 



Node Source 
1304 




Leaf Node 1308 



Metadata 
1312 



Media 



7^, 13 



Docket Number: MSI -1848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 11 of 18 



Root Node 1402 







Node 1404 



Leaf Node 1408 



Node 1406 



Event(s) 1414 




Node Added 1416 






Node Removed 1418 






Node Changing 1420 






Node Changed 1422 






Remove Children 1424 






Node Source Added 1426 






Node Source Removed 1428 






Node Sorted 1430 






Node Moved 1432 








Leaf Node 1410 



LeafNode 1412 



Docket Number: MS 1-1 848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 12 of 18 



1500 



Sequence Node 1502 

z 



Leaf Node 1504 



Metadata 1510 




1516 






\\wmp\ 






content\ 






mpeg\ 






Boom.mpe 







Leaf Node 1506 



Metadata 1512 




1518 






\\wmp\ 






content\ 






Formats\ 






MovieFile\ 






chimp, mpg 







Leaf Node 1508 



Metadata 1514 




1520 j 






\\wmp\ 






content\ 






mpeg\ 






Boom.mpe 







t5 



Docket Number: MS1-1848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 13 of 18 

1600 — ^ 



Parallel Node 1602 



Sequence Node 1604 




Major Type 1608 
Video 





Leaf Node 1612 

Start Time 1616 
0 



Stop Time 1618 
30 



Media Start 1620 
50 



Media Stop 1622 
80 





Sequence Node 1606 , 






Major Type 1610 
Audio \ 





Leaf Node 1630 



Start Time 1634 
20 



Stop Time 1636 
40 



Media Start 1638 
0 



Leaf Node 1614 




Start Time 1624 
30 




Stop Time 1 626 
40 






Media Start 1628 
0 







Leaf Node 1632 



Start Time 1640 
40 



Stop Time 1642 
60 



Media Start 1644 
0 



16 



Docket Number: MS1-1848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 14 of 18 



1700 



0 
I 
I 



10 
I 
I 

_]_ 



20 
I 
I 



30 



Al.asf 1702 



Cross Fade 1706 



A2.asf 1704 



7^- 17 



1800 



Parallel Node 1802 



Effect 1812 
Cross Fade 



Start Time 1808 
10 



Stop Time 1810 
20 



Leaf Node 1804 



Start Time 1814 
0 



Stop Time 1816 
20 



Pointer 1822 
Al.asf 



Leaf Node 1806 

Start Time 1818 
10 

Stop Time 1820 
30 

Pointer 1824 
A2.asf 



Docket Number: MSI -1848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 15 of 18 



RECEIVING A REQUEST FROM 
AN APPLICATION AT AN API 
TO INTERACT WITH A 
PLURALITY OF MEDIA 



1904 

GENERATING A MEDIA 
TIMELINE BASED ON 
THE REQUEST FOR 

EXPOSURE VIA THE API 
TO THE APPLICATION 



2002 

SPECIFYING AN EFFECT TO BE 
APPLIED TO ONE OR MORE OF 
A PLURALITY OF MEDIA WHEN 
THE MEDIA IS RENDERED 



2004 

GENERATING A MEDIA TIMELINE FOR EXPOSURE 
VIA AN API THAT INCLUDES A PLURALITY OF 

NODES, ONE OR MORE OF THE NODES REFERENCE 
ONE OR MORE OF THE MEDIA AND INCLUDE 
METADATA THAT DESCRIBES THE EFFECT 




1902 



v 





20 



Docket Number: MSI -1848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 16 of 18 



2102 

RENDERING A FIRST MEDIA 
ITEM REFERENCED BY A 
FIRST NODE 



2104 

RECEIVING A CALL FOR A SECOND 
NODE THAT REFERENCES A 
SECOND MEDIA ITEM 



2106 

CREATING THE SECOND 
NODE 



21 



2202 

RENDERING A FIRST NODE 
TO OUTPUT A REFERENCED 
FIRST MEDIA 



2204 

CHANGING ONE OR MORE 
PROPERTIES OF A SECOND NODE 



2206 

INITIATING AN EVENT FOR 
COMMUNICATION TO A 
PARENT OF THE NODE 



?<^. 22 



Docket Number: MS1-1848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 17 of 18 



2300 



2302 

LOADING A FIRST 
NODE 



2304 

EXAMINING THE FIRST 
NODE TO DETERMINE A 
FIRST NODE GROUPING 



2306 

LOADING EACH NODE 
REFERENCED BY THE 
FIRST NODE GROUPING 



2308 

RENDERING THE FIRST 
NODE GROUPING 



2310 

EXAMINING ONE OR MORE OF 
THE NODES IN THE FIRST NODE 
GROUPING TO DETERMINE A 
SECOND NODE GROUPING 



2312 

LOADING EACH NODE 
REFERENCED BY THE 
SECOND NODE GROUPING 



2314 

WHEN RENDERING OF THE FIRST NODE 
GROUPING IS COMPLETED, THE SECOND 
NODE GROUPING IS RENDERED 



23 



2400 



Docket Number: MS 1-1 848 US 
Inventor: Rahman et al. 
Title: Media Timeline 
Page 18 of 18 

2428 2450 
2432 



Remote 
Device 




2446 



2408 
2456 



Remote 
Software 
Components 



ooo D jg 

□□□□□ [J 



2434 



Video Adapter 



Data Media 
Interfaces 



A 
V 



O □□□□□ 



Network 
Adapter 



System Bus 



Operating 2 416' 
System 



Application 2418' 
Programs ^ 



Software 2420' 
^ omponents _^^ 

Program 242 2' 
_ Data > 



2424 



2404 




Processing 
Unit 

2442 



□□□□□ 



□ 



System Memory 



Operating 
System 2416 



Application 
Programs2418 



Software 
Components 2420 



Program 
Data 2422 



2412 



RAM 



BIOS 



2414 



2410 



ROM 



I/O Interfaces 




